Ghazni Province
Fraud-R1 : A Multi-Round Benchmark for Assessing the Robustness of LLM Against Augmented Fraud and Phishing Inducements
Yang, Shu, Zhu, Shenzhe, Wu, Zeyu, Wang, Keyu, Yao, Junchi, Wu, Junchao, Hu, Lijie, Li, Mengdi, Wong, Derek F., Wang, Di
We introduce Fraud-R1, a benchmark designed to evaluate LLMs' ability to defend against internet fraud and phishing in dynamic, real-world scenarios. Fraud-R1 comprises 8,564 fraud cases sourced from phishing scams, fake job postings, social media, and news, categorized into 5 major fraud types. Unlike previous benchmarks, Fraud-R1 introduces a multi-round evaluation pipeline to assess LLMs' resistance to fraud at different stages, including credibility building, urgency creation, and emotional manipulation. Furthermore, we evaluate 15 LLMs under two settings: 1. Helpful-Assistant, where the LLM provides general decision-making assistance, and 2. Role-play, where the model assumes a specific persona, widely used in real-world agent-based interactions. Our evaluation reveals the significant challenges in defending against fraud and phishing inducement, especially in role-play settings and fake job postings. Additionally, we observe a substantial performance gap between Chinese and English, underscoring the need for improved multilingual fraud detection capabilities.
- North America > Canada > Ontario > Toronto (0.14)
- Asia > Middle East > UAE > Abu Dhabi Emirate > Abu Dhabi (0.14)
- Asia > China > Beijing > Beijing (0.05)
- (20 more...)
- Law Enforcement & Public Safety > Fraud (1.00)
- Information Technology > Security & Privacy (1.00)
SEKE: Specialised Experts for Keyword Extraction
Martinc, Matej, Tran, Hanh Thi Hong, Pollak, Senja, Koloski, Boshko
Keyword extraction involves identifying the most descriptive words in a document, allowing automatic categorisation and summarisation of large quantities of diverse textual data. Relying on the insight that real-world keyword detection often requires handling of diverse content, we propose a novel supervised keyword extraction approach based on the mixture of experts (MoE) technique. MoE uses a learnable routing sub-network to direct information to specialised experts, allowing them to specialize in distinct regions of the input space. SEKE, a mixture of Specialised Experts for supervised Keyword Extraction, uses DeBERTa as the backbone model and builds on the MoE framework, where experts attend to each token, by integrating it with a recurrent neural network (RNN), to allow successful extraction even on smaller corpora, where specialisation is harder due to lack of training data. The MoE framework also provides an insight into inner workings of individual experts, enhancing the explainability of the approach. We benchmark SEKE on multiple English datasets, achieving state-of-the-art performance compared to strong supervised and unsupervised baselines. Our analysis reveals that depending on data size and type, experts specialize in distinct syntactic and semantic components, such as punctuation, stopwords, parts-of-speech, or named entities. Code is available at: https://github.com/matejMartinc/SEKE_keyword_extraction
- North America > United States > Minnesota > Hennepin County > Minneapolis (0.14)
- Asia > Japan (0.04)
- North America > Canada (0.04)
- (14 more...)
- Information Technology > Artificial Intelligence > Natural Language > Text Processing (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Information Retrieval (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
Official: US drone kills 26 Taliban in eastern Afghanistan
KABUL, Afghanistan – An Afghan official says two U.S. drone strikes this week hit a building where dozens of Taliban were meeting in southeastern province of Ghazni, killing 26 insurgents and wounding 22. Arif Noori, a provincial spokesman, says the drone assault was carried out on Tuesday during an offensive in Ghazni province's Andar district where the U.S. military came to the aid of Afghan security forces battling the Taliban. He says among those killed was a senior commander, known only as Aqhani, who ran the insurgency in Ghazni province. The first U.S. drone strike hit the building, the second struck an hour later after more Taliban had gathered at the scene.
- Asia > Afghanistan > Ghazni Province > Ghazni (0.90)
- Asia > Afghanistan > Kabul Province > Kabul (0.33)
- Government > Military (1.00)
- Government > Regional Government > Asia Government > Afghanistan Government (0.33)
Pakistan: US missiles kill 3 militants near Afghan border
DERA ISMAIL KHAN, Pakistan – Pakistani intelligence officials say a suspected U.S. drone strike has hit a militant compound near the Afghan border, killing three militants. Two officials say the unmanned drone fired two missiles at the Ghazni compound of the militant Haqqani network's commander Abdur Rasheed early in the morning on Thursday. The network is affiliated with the Taliban. They said it's unclear if Rasheed was at the compound located on the Pesho Ghar mountain in the Kurram tribal region's Ghuzgari area. The officials spoke on condition of anonymity because they are not authorized to speak to the media.
- Asia > Pakistan (0.74)
- Asia > Afghanistan > Ghazni Province > Ghazni (0.31)